Mobile device management for synchronized audio playback in coordination with external video playback

ABSTRACT

Embodiments of the invention provide a method, system and computer program product for mobile device management during synchronized audio playback in coordination with external video playback. In an embodiment of the invention, a method for mobile device management during synchronized audio playback in coordination with external video playback includes receiving in memory of a mobile device a request to synchronize playback of an audio file through the mobile device with a presentation of video externally to the mobile device and in response to the request, automatically disabling access to a media recording system of the mobile device and synchronizing playback of the audio file with the external presentation of the video.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation-in-Part of U.S. application Ser. No.14/501,625, filed on Sep. 30, 2014, presently pending, the entireteachings of which are incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to audio playback in a mobile device andmore particularly to audio playback in coordination with external videoplayback.

2. Description of the Related Art

Video playback refers to the presentation on a display substrate ofpreviously recorded video imagery. Historically, video playback includedmerely the projection of a multiplicity of frames stored in a pancake offilm onto screen—typically fabric. Audio playback simultaneouslyoccurred with the playback of video imagery in a coordinated fashionbased upon the transduction of optical patterns imprinted upon the filmin association with one or more frames of imagery also imprinted uponthe film. Thus, the coordination of playback of both audio and videoremained the responsibility of a single projection device in the contextof traditional film projection.

Unlike motion pictures, in the scholastic environment and even in thecontext of modern visual presentations, visual playback of a series ofimages such as a slide show occur separately from the playback ofaccompanying audio. In this regard, it is customary for the presenter toinitiate playback, and in response to a particular cue, such as thepresentation of a slide that states, “press play now”, the presenter canmanually initiate playback of an audio cassette to audibly supplementthe presentation of a series of slides in the slide show. However, thenecessity of precision in coordinating the playback of the audiocassette with the presentation of different slides is lacking in thateach slide of the slide show may remain visible on a presentation screenfor an extended duration.

Coordinating the playback of audio separately from the projection of afilm in a movie theater is not a problem of present considerationbecause modern file projectors manage both audio and video playback.However, circumstances arise where external audio may be desired insupplement to or in replacement of the audio inherently present duringthe projection of a film. For example, for an audience member whocomprehends a language other than the language of a presented film andother audience members, it is desirable to simulcast audio of a languagenative to the audience member in lieu of the audio of the presented filmthat differs from the language of the audience member. Yet, coordinatingthe synchronized playback of the supplemental audio with the playback ofthe video without the cooperation of the projectionist of the film canbe a manually intensive process of timing the initiation of the playbackof the supplemental audio in respect to a particular cue of the film.

Of note, the use of a mobile device to support synchronized audioplayback within a theater environment is disfavored. In particular,recording devices are strictly prohibited by most if not all movietheaters so as to avoid the filming of a motion picture for subsequentunauthorized re-distribution to others. Yet, most mobile devices includeaudio and video recording functionality. Also, mobile devices such as amobile telephone can generate a variety of audible and visualdisturbances irritating to other theater-goers. Examples include theloud ringing of a cellular telephone, or the sounds produced by a mobiledevice upon receipt of a text message, e-mail message or voice mail.Other examples include the bright lights produced by the backlighting ofa mobile phone which can disturb nearby customers. As such, utilizing amobile phone to facilitate the playback of audio which is supplementalto the audio of a projected film in a theater environment can beproblematic.

BRIEF SUMMARY OF THE INVENTION

Embodiments of the present invention address deficiencies of the art inrespect to the use of a mobile device during audio playback synchronizedwith external video playback and provide a novel and non-obvious method,system and computer program product for mobile device management duringsynchronized audio playback in coordination with external videoplayback. In an embodiment of the invention, a method for mobile devicemanagement during synchronized audio playback in coordination withexternal video playback includes receiving in memory of a mobile devicea request to synchronize playback of an audio file through the mobiledevice with a presentation of video externally to the mobile device andin response to the request, automatically disabling access to a mediarecording system of the mobile device and synchronizing playback of theaudio file with the external presentation of the video.

In one aspect of the embodiment, the media recording system is an audiorecording system. In another aspect of the embodiment, the mediarecording system is a video recording system. In yet another aspect ofthe embodiment, the method further includes disabling a camera in themobile device. In even yet another aspect of the embodiment, the methodfurther includes detecting a cessation of the playback of the audio filein the mobile device and in response to the cessation, re-enablingaccess to the media recording system. Finally, in even yet anotheraspect of the embodiment, the method further includes detecting ambientlighting through a camera of the mobile device and in response,re-enabling access to the media-recording system.

In another embodiment of the invention, a data processing system isconfigured for mobile device management during synchronized audioplayback in coordination with external video playback. The systemincludes a mobile computing device that has at least one processor,memory, cellular telephony circuitry and a display. The system alsoincludes an audio synchronization module executing in the memory of themobile computing device. The module includes program code enabled torespond to a request to synchronize playback of an audio file throughthe mobile device with a presentation of video externally to the mobiledevice by automatically disabling access to a media recording system ofthe mobile device and synchronizing playback of the audio file with theexternal presentation of the video.

Additional aspects of the invention will be set forth in part in thedescription which follows, and in part will be obvious from thedescription, or may be learned by practice of the invention. The aspectsof the invention will be realized and attained by means of the elementsand combinations particularly pointed out in the appended claims. It isto be understood that both the foregoing general description and thefollowing detailed description are exemplary and explanatory only andare not restrictive of the invention, as claimed.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute partof this specification, illustrate embodiments of the invention andtogether with the description, serve to explain the principles of theinvention. The embodiments illustrated herein are presently preferred,it being understood, however, that the invention is not limited to theprecise arrangements and instrumentalities shown, wherein:

FIG. 1 is a pictorial illustration of a process for mobile devicemanagement during synchronized audio playback in coordination withexternal video playback;

FIG. 2 is a schematic illustration of a data processing systemconfigured for mobile device management during synchronized audioplayback in coordination with external video playback; and,

FIG. 3 is a flow chart illustrating a process for mobile devicemanagement during synchronized audio playback in coordination withexternal video playback.

DETAILED DESCRIPTION OF THE INVENTION

Embodiments of the invention provide for mobile device management duringsynchronized audio playback in coordination with external videoplayback. In accordance with an embodiment of the invention, a requestcan be received in memory of a mobile device to synchronize playback ofan audio track stored in the mobile device. In response to the request,a directive can be issued to the mobile device to disable a mediarecording system of the mobile device. In this regard, the mediarecording system can be an audio recording system, a video recordingsystem or an audio-visual recording system. Thereafter, upon determininga cessation of the synchronized playback of the audio track in themobile device, the media recording system can be re-enabled.Alternatively, a level of ambient lighting can be detected by a cameraof the mobile device. In response to detecting a threshold degree ofambient lighting, the media recording system can be re-enabled.

In further illustration, FIG. 1 pictorially shows a process for mobiledevice management during synchronized audio playback in coordinationwith external video playback. As shown in FIG. 1, a film projector 110can project a motion picture onto a screen 120 such as is the case in amovie theater. A mobile device 140 in proximity to the screen 120 canhost the execution of audio synchronization logic 150. Thesynchronization logic 150 during execution can present a user interfacein a display 130 of the mobile device 140 with a control in response tothe activation of which, the audio synchronization logic 150 can directthe mobile device 140 to transduce the audio of the projected file foruse by the audio synchronization logic 150 in synchronizing the playbackof a stored audio file 160 through an audio output device of the mobiledevice 140. In this regard, the stored audio file can be substantiallyequivalent to the audio of the film projected onto the screen 120excepting that the stored audio file 160 can be of a different language.

Of note, prior to the selection of the control in the user interface ofthe display 130 indicating a request to begin audio synchronization,different media recording systems 170 of the mobile device 140 canremain operable. For instance, a video recoding system 170A, a camera170B, and an audio recording system 170C can remain operable such thatthe video recoding system 170A can record video through an onboard videocamera disposed in the mobile device 140, a camera 170B can acquirestatic imagery through an onboard still camera of the mobile device 140,and an audio recording system 170C can record audio through an onboardmicrophone of the mobile device 140. In response to the selection of thecontrol in the user interface of the display 130, however, the audiosynchronization logic 150 can direct the mobile device 140 to disableeach present one of the media recording systems 170.

The process described in connection with FIG. 1 can be implemented in adata processing system. In further illustration, FIG. 2 schematicallyshows a data processing system configured for mobile device managementduring synchronized audio playback in coordination with external videoplayback. The system can include a mobile device 200, for instance asmart phone, tablet computer or personal digital assistant. The mobiledevice 200 can include at least one processor 220 and memory 230. Themobile device 200 additionally can include cellular communicationscircuitry 210 arranged to support cellular communications in the mobiledevice 200, as well as data communications circuitry 240 arranged tosupport data communications.

An operating system 260 can execute in the memory 230 by the processor220 of the mobile device 200 and can support the operation of a numberof computer programs, including a camera recorder 235 and a voicerecorder 245. Further, a display management program 255 can operatethrough the operating system 260 as can an audio management program 265.Of note, an audio synchronization module 300 can be hosted by theoperating system 260. The audio synchronization module 300 can includeprogram code that, when executed in the memory 230 by the operatingsystem 260, can act to synchronize the playback through audio outputcircuitry 270 of a selected audio track 215 in data store 250 of themobile device 200 in supplement to an externally projected motionpicture.

In this regard, the program code of the audio synchronization module 300is enabled to detect external audio provided by the projection of amotion picture through microphone 280. Speech recognition engine 225also executing in the memory 230 by the operating system 260 can processthe external audio to compare the resultant text to a known textualfingerprint so as to determine a position of the audio track to playback in synchronization with the detected external audio. Periodically,the program code of the audio synchronization module 300 can detectcontemporaneously broadcast external audio provided by the projection ofthe motion picture. The detected audio again can be speech recognized bythe speech recognition engine 225 so as to produce text for comparisonwith a known transcription of audio of the motion picture. Based uponthe matching of the speech recognized text to text in the transcription,the program code of the audio synchronization module 300 is able toprecisely locate a contemporaneous position of the detected externalaudio so as to coordinate the precise location in the audio track 215 tobe played back through the audio output circuitry 270.

Importantly, the program code of the audio synchronization module 300can be additionally enabled to respond to a request to synchronize theaudio track 215 by directing the camera recorder 235 to enter a disabledmode in which at least the functionality of recording cannot be accessedor initiated. Likewise, the program code of the audio synchronizationmodule 300 can be enabled to respond to a request to synchronize theaudio track 215 by directing the voice recorder 245 to enter a disabledmode in which at least the functionality of recording cannot be accessedor initiated. Finally, as yet a further option, the program code of theaudio synchronization module can be enabled to direct the camerarecorder 235 to disable access to acquiring a static image.

Optionally, the program code of the audio synchronization module 300 canbe enabled to detect a degree of ambient lighting through camerarecorder 235. To the extent that the program code of the audiosynchronization module 300 detects sufficient ambient lighting, theprogram code of the audio synchronization module 300 can direct thedisplay management program 255 to restore access to the recordingfunctionality of the camera recorder 235 and the voice recorder 245.Conversely, to the extent that the program code of the audiosynchronization module 300 detects insufficient ambient lighting, theprogram code of the audio synchronization module 300 can be enabled todirect the camera recorder 235 and the voice recorder 245 to re-enterthe disabled mode in which at least the functionality of recordingcannot be accessed or initiated. In either circumstance, in response todetermining the termination of the audio synchronization, the programcode of the audio synchronization module 300 can restore access to therecording functionality of the camera recorder 235 and the voicerecorder 245.

In even yet further illustration of the operation of the audiosynchronization module 300, FIG. 3 is a flow chart illustrating aprocess for mobile device management during synchronized audio playbackin coordination with external video playback. Beginning in block 310, arequest for audio synchronization can be received. In block 320A, acamera recording function of the mobile device can be disabled and inblock 320B, a camera photo acquisition function can be disabled.Finally, in block 330, an audio recording function of the mobile devicecan be disabled.

In decision block 340, it can be determined if a threshold amount ofambient lighting is detected to indicate the presence of the mobilephone in a lighted room. If not, in block 350 the recording video andaudio recording functionality of the mobile device can remain disabledalong with the ability to utilize an onboard camera to acquirephotographic imagery. However, if it is determined that a thresholdamount of ambient lighting is detected to indicate the presence of themobile phone in a lighted room, in block 360 the recording video andaudio recording functionality of the mobile device can be restored alongwith the ability to utilize an onboard camera to acquire photographicimagery. Thereafter, in decision block 370 it can be determined if thesynchronization of the audio has ended. If not, the process can returnto decision block 340. Otherwise, in block 380 the recording video andaudio recording functionality of the mobile device can be restored alongwith the ability to utilize an onboard camera to acquire photographicimagery.

The present invention may be embodied within a system, a method, acomputer program product or any combination thereof. The computerprogram product may include a computer readable storage medium or mediahaving computer readable program instructions thereon for causing aprocessor to carry out aspects of the present invention. The computerreadable storage medium can be a tangible device that can retain andstore instructions for use by an instruction execution device. Thecomputer readable storage medium may be, for example, but is not limitedto, an electronic storage device, a magnetic storage device, an opticalstorage device, an electromagnetic storage device, a semiconductorstorage device, or any suitable combination of the foregoing.

A non-exhaustive list of more specific examples of the computer readablestorage medium includes the following: a portable computer diskette, ahard disk, a random access memory (RAM), a read-only memory (ROM), anerasable programmable read-only memory (EPROM or Flash memory), a staticrandom access memory (SRAM), a portable compact disc read-only memory(CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk,a mechanically encoded device such as punch-cards or raised structuresin a groove having instructions recorded thereon, and any suitablecombination of the foregoing. A computer readable storage medium, asused herein, is not to be construed as being transitory signals per se,such as radio waves or other freely propagating electromagnetic waves,electromagnetic waves propagating through a waveguide or othertransmission media (e.g., light pulses passing through a fiber-opticcable), or electrical signals transmitted through a wire.

Computer readable program instructions described herein can bedownloaded to respective computing/processing devices from a computerreadable storage medium or to an external computer or external storagedevice via a network, for example, the Internet, a local area network, awide area network and/or a wireless network. The network may comprisecopper transmission cables, optical transmission fibers, wirelesstransmission, routers, firewalls, switches, gateway computers and/oredge servers. A network adapter card or network interface in eachcomputing/processing device receives computer readable programinstructions from the network and forwards the computer readable programinstructions for storage in a computer readable storage medium withinthe respective computing/processing device.

Computer readable program instructions for carrying out operations ofthe present invention may be assembler instructions,instruction-set-architecture (ISA) instructions, machine instructions,machine dependent instructions, microcode, firmware instructions,state-setting data, or either source code or object code written in anycombination of one or more programming languages, including an objectoriented programming language such as Smalltalk, C++ or the like, andconventional procedural programming languages, such as the “C”programming language or similar programming languages. The computerreadable program instructions may execute entirely on the user'scomputer, partly on the user's computer, as a stand-alone softwarepackage, partly on the user's computer and partly on a remote computeror entirely on the remote computer or server. In the latter scenario,the remote computer may be connected to the user's computer through anytype of network, including a local area network (LAN) or a wide areanetwork (WAN), or the connection may be made to an external computer(for example, through the Internet using an Internet Service Provider).In some embodiments, electronic circuitry including, for example,programmable logic circuitry, field-programmable gate arrays (FPGA), orprogrammable logic arrays (PLA) may execute the computer readableprogram instructions by utilizing state information of the computerreadable program instructions to personalize the electronic circuitry,in order to perform aspects of the present invention.

Aspects of the present invention are described herein with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems), and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer readable program instructions.

These computer readable program instructions may be provided to aprocessor of a general purpose computer, special purpose computer, orother programmable data processing apparatus to produce a machine, suchthat the instructions, which execute via the processor of the computeror other programmable data processing apparatus, create means forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks. These computer readable program instructionsmay also be stored in a computer readable storage medium that can directa computer, a programmable data processing apparatus, and/or otherdevices to function in a particular manner, such that the computerreadable storage medium having instructions stored therein comprises anarticle of manufacture including instructions which implement aspects ofthe function/act specified in the flowchart and/or block diagram blockor blocks.

The computer readable program instructions may also be loaded onto acomputer, other programmable data processing apparatus, or other deviceto cause a series of operational steps to be performed on the computer,other programmable apparatus or other device to produce a computerimplemented process, such that the instructions which execute on thecomputer, other programmable apparatus, or other device implement thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof instructions, which comprises one or more executable instructions forimplementing the specified logical function(s). In some alternativeimplementations, the functions noted in the block may occur out of theorder noted in the figures. For example, two blocks shown in successionmay, in fact, be executed substantially concurrently, or the blocks maysometimes be executed in the reverse order, depending upon thefunctionality involved. It will also be noted that each block of theblock diagrams and/or flowchart illustration, and combinations of blocksin the block diagrams and/or flowchart illustration, can be implementedby special purpose hardware-based systems that perform the specifiedfunctions or acts or carry out combinations of special purpose hardwareand computer instructions.

Finally, the terminology used herein is for the purpose of describingparticular embodiments only and is not intended to be limiting of theinvention. As used herein, the singular forms “a”, “an” and “the” areintended to include the plural forms as well, unless the context clearlyindicates otherwise. It will be further understood that the terms“comprises” and/or “comprising,” when used in this specification,specify the presence of stated features, integers, steps, operations,elements, and/or components, but do not preclude the presence oraddition of one or more other features, integers, steps, operations,elements, components, and/or groups thereof.

The corresponding structures, materials, acts, and equivalents of allmeans or step plus function elements in the claims below are intended toinclude any structure, material, or act for performing the function incombination with other claimed elements as specifically claimed. Thedescription of the present invention has been presented for purposes ofillustration and description, but is not intended to be exhaustive orlimited to the invention in the form disclosed. Many modifications andvariations will be apparent to those of ordinary skill in the artwithout departing from the scope and spirit of the invention. Theembodiment was chosen and described in order to best explain theprinciples of the invention and the practical application, and to enableothers of ordinary skill in the art to understand the invention forvarious embodiments with various modifications as are suited to theparticular use contemplated.

Having thus described the invention of the present application in detailand by reference to embodiments thereof, it will be apparent thatmodifications and variations are possible without departing from thescope of the invention defined in the appended claims as follows:

We claim:
 1. A method for mobile device management during synchronizedaudio playback in coordination with external video playback, the methodcomprising: receiving in memory of a mobile device a request tosynchronize playback of an audio file through the mobile device with apresentation of video externally to the mobile device; and, responsiveto the request, automatically disabling access to a media recordingsystem of the mobile device and synchronizing playback of the audio filewith the external presentation of the video.
 2. The method of claim 1,further comprising: automatically disabling a camera in the mobiledevice.
 3. The method of claim 1, wherein the media recording system isa video recording system.
 4. The method of claim 1, wherein the mediarecording system is an audio recording system.
 5. The method of claim 1,further comprising: detecting a cessation of the playback of the audiofile in the mobile device; and, responsive to the cessation, re-enablingaccess to the media recording system.
 6. The method of claim 1, furthercomprising: detecting ambient lighting through a camera of the mobiledevice; and, responsive to a detection of ambient lighting exceeding athreshold level, re-enabling access to the media recording system.
 7. Adata processing system configured for mobile device management duringsynchronized audio playback in coordination with external videoplayback, the system comprising: a mobile computing device comprising atleast one processor, memory, cellular telephony circuitry and a display;and, an audio synchronization module executing in the memory of themobile computing device, the module comprising program code enabled torespond to a request to synchronize playback of an audio file throughthe mobile device with a presentation of video externally to the mobiledevice by automatically disabling access to a media recording system andsynchronizing playback of the audio file with the external presentationof the video.
 8. The system of claim 7, wherein the program code isfurther enabled to automatically disable a camera in the mobile device.9. The system of claim 7, wherein the media recording system is a videorecording system.
 10. The system of claim 7, wherein the media recordingsystem is an audio recording system.
 11. The system of claim 7, whereinthe program code is further enabled to detect a cessation of theplayback of the audio file in the mobile device and in response to thecessation, to re-enable access to the media recording system.
 12. Thesystem of claim 7, wherein the program code is further enabled to detectambient lighting through a camera of the mobile device and to respond toa detection of ambient lighting exceeding a threshold level, byre-enabling access to the media recording system.
 13. A computer programproduct for mobile device management during synchronized audio playbackin coordination with external video playback, the computer programproduct comprising a computer readable storage memory having programinstructions embodied therewith, the program instructions executable bya device to cause the device to perform a method comprising: receivingin memory of a mobile device a request to synchronize playback of anaudio file through the mobile device with a presentation of videoexternally to the mobile device; and, responsive to the request,disabling access to a media recording system of the mobile device andsynchronizing playback of the audio file with the external presentationof the video.
 14. The program product of claim 13, wherein the methodfurther comprises: automatically disabling a camera in the mobiledevice.
 15. The program product of claim 13, wherein the media recordingsystem is a video recording system.
 16. The program product of claim 13,wherein the media recording system is an audio recording system.
 17. Theprogram product of claim 13, wherein the method further comprises:detecting a cessation of the playback of the audio file in the mobiledevice; and, responsive to the cessation, re-enabling access to themedia recording system.
 18. The program product of claim 13, wherein themethod further comprises: detecting ambient lighting through a camera ofthe mobile device; and, responsive to a detection of ambient lightingexceeding a threshold level, re-enabling access to the media recordingsystem.